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We discuss how spreading processes on temporal networks are impacted by the shape of their 
inter-event time distributions. Through simple mathematical arguments and toy examples, we find 
that the key factor is the ordering in which events take place, a property that tends to be affected by 
the bulk of the distributions and not only by their tail, as usually considered in the literature. We 
show that a detailed modeling of the temporal patterns observed in complex networks can change 
dramatically the properties of a spreading process, such as the ergodicity of a random walk process 
or the persistence of an epidemic. 



INTRODUCTION 

When modeling diffusive processes in systems made of 
interacting elements [l[ , a majority of works has adopted 
a Poisson viewpoint, where stochastic events take place 
at a constant rate. For instance, in models of disease 
spreading over contact networks [2j , it is usually assumed 
that the probabilities per unit time of disease transmis- 
sion and of recovery from disease are constant, implying 
exponential distributions of the time intervals between 
events. This assumption has important consequences on 
the mathematical nature of the models, as they become 
mcniorylcss and they conveniently reduce to ordinary dif- 
ferential equation models. In situations when only the av- 
erage rate of the events is known, this approach is statis- 
tically justified by the principle of maximum entropy Q. 
However, growing evidence shows that inter-event time 
statistics significantlydeviates from Poisson processes in 
a variety of systems |4( , with important consequences on 
the dynamical and asymptotic properties of spreading 
models For instance, the distribution of duration 

of most diseases has a sharp peak about the average value 
and is highly non-exponential 0, Hoj |. Similarly, times 
between contacts 11 1 or communication 12, 13| between 
individuals also tend to deviate from a Poisson process, 
but this time by exhibiting a bursty behaviour, namely 
an intermittent switching between periods of low activ- 
ity and high activity, and a fat-tailed inter-event time 
distributions 
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Incorporating non-exponential distributions into a 
mathematical modeling of diffusion leads to intcgro- 



diffcrential equations [ 1 5M 1 7| , where the evolution of the 
system at some time depends on an integration of its 
states over its past, i.e. the random process becomes 
non-Markovian. An important aspect of these equations 
is that they account for the importance of the time or- 
dering of events on dynamics. Typically, for one event 
to take place, some other event should not have taken 
place before. In the case of disease spreading, for in- 
stance, an infected individual can only transmit the dis- 



ease at a certain time if is has not recovered at that 
time. The main purpose of this article is to investigate 
the properties of inter-event time distributions that affect 
spreading. In particular, we will emphasize the impor- 
tance of time ordering for two different types of diffusive 
processes, namely random walks and epidemic spreading. 



DIFFUSION AND TIME ORDERING 
From data to models 

In a majority of empirical systems, networks are not 
static entities, as edges and nodes can appear and dis- 
appear in time. A natural framework to study time- 
dependent complex systems is to use temporal networks 
1 81 ] , in which one accounts for the timings of interactions 
instead of assuming static connectivity. The modeling of 
temporal networks requires one finding the right level 
of abstraction, which allows for a mathematical analysis 
while preserving key properties of the data. In that direc- 
tion, a promising approach consists in building stochas- 
tically evolving networks where the appearance of edges 
between nodes is a stochastic process, built such as to 
preserve the inter-event time distribution observed in the 
data. 

In practice, stochastic models are constructed as fol- 
lows. Let us consider an empirical system observed dur- 
ing a time interval T, made of N nodes, and where edges 
between two nodes, say from i to j, appear at times 
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Hi %3 ^}i where n, 3 is the total number 



of activations of that edge. The sequence is ordered such 
that t °j^ < tjj if a < b. For the sake of simplicity, we will 
further assume that edges remain present for infinitesi- 
mally small times, in order to avoid several edges to be 
present at the same time. The modeling step consists 
in replacing the exact sequence of activation times by a 
random sequence where events take place according to 
an inter-activation time /y(r) fitted on the data. More 
precisely, fij(r)dT is the probability to observe a time in- 
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terval of duration in [r, r + dr] between two activations of 
the edge. By convention, fij(r) is only defined for edges 
that are activated at least once. For those, /y(r) verifies 



f ij (r)dT = l, 



and 
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/ rfij{T)dT = {r)i 
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gives the expected time between two activations of an 
edge. 

When modeling the diffusion of an entity on the net- 
work, however, the distribution fij(r) only plays an in- 
direct role. The important quantity is instead the wait- 
ing time distribution ipij{t) that the entity arriving on 
i has to wait for a duration t before an edge towards 
j is available. The waiting time t is often called re- 
lay time. In epidemic spreading, it is the time it takes 
for a newly infected node to spread the infection further 
via the corresponding link. Assuming that the activa- 
tions of neighbouring edges are independent (29j and that 
nodes become infected at uniformly random times, inter- 
activation time distribution and waiting time distribution 
verify the relation TjJ 2oT ] 



( T )y Jt 



fa ( T ) dT 



(3) 



derived as follows. The probability for the walker to ar- 
rive in an inter-activation time of duration r is propor- 
tional to r, more precisely r ft J . v ■ The probability to 
wait for a duration of length t is simply given by the 
probability to land in an inter-activation time of length 
r > t, precisely at time r — t in this interval. As the 
probability to arrive in an interval is uniform, one finds 

rfio(r) 1 



-dr 



(4) 



and hence the above relation. The average waiting time 
can be computed from the latter after integrating by 
parts 
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showing that the average waiting time depends on the 
variance of the inter-activation time. At a fixed value of 
the average inter-activation time, the waiting time can be 
arbitrarily large if the variance of inter-activation times 
is sufficiently large. This paradox, often called waiting 
time paradox or bus paradox in queuing theory plj . is 
an example of length-biased sampling. Let us note that 
waiting-times and inter-activation times have the same 
distribution when the process is Poissonian, in which case 



i>ij{t) = fij(t) 
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and that their tail has the same nature in the case of 
power-law tails 
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The quantity (t)ij/{r)ij — 1, which is zero for a Poisson 
process and positive or even infinite for a power law, is a 
standard measure for the burstiness of a process 2(J 22| ■ 



Two spreading models 

In this section, we focus on two popular models for 
diffusion on networks, and show that in both cases, the 
non-Markovianity of the random process alters the dif- 
fusion by changing the ordering in which two types of 
events take place. The nature of these events is however 
different in each case. From now on, we will only consider 
the waiting-time distribution ipij(t), relevant to describe 
dynamical processes on networks, and focus on the asso- 
ciated stochastic temporal network, in which edges ap- 
pear randomly according to the assigned waiting times. 



Random Walks 

Random walk processes are a generic model for diffu- 
sion, also used to uncover prominent structural features 
of networks. Applied to stochastic temporal networks, 
the model is defined in continuous time as follows [l7| . 
A walker located at a node i remains on it until an edge 
leaving i toward some node j appears. When such an 
event occurs, the walker jumps to j without delay and 
then waits until an edge leaving j appears. It is impor- 
tant to note that the probability for the walker to jump 
to j depends on ipij(t), but also on all tjjik(t), where k are 
neighbours of i, because the walker takes the first edge 
available for transport. Once a walker has left a node, 
edges leaving this node become useless for transport. For 
this reason, the probability to actually make a step from 
i to j is given by 



Ta (t) = (t) x n 



ipik (O dt' 



(8) 



where each factor in the product denotes the probability 
that an edge does not appear before time t. The proba- 
bility for making a jump to node j is given by the effective 
transition matrix 



Tij(t)dt . 



that verifies 



(9) 



(10) 
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When only two edges leave node i, say to j and k, 
simplifies into 



Tij (t) = T/iij (t) J ip ik {t')dt'. (11) 



Epidemic spreading 

Epidemic spreading differs from random walk processes 
because the number of infected individuals is not con- 
served. It may decrease when an infected person recov- 
ers, or increase when an infected person infects several of 
its contacts. When applied on stochastic temporal net- 
works, standard models of epidemic spreading are char- 
acterized by two distributions: i) the probability distri- 
bution ipij{t) that the infected node i makes a contact 
sufficient to transmit the disease to node j at time t, after 
he has been infected at time 0; the probability distribu- 
tion ri(t) that node i infected by the disease recovers at 
time t. As an infected individual can only transmit the 
disease to a susceptible neighbor if it is still infected at 
the time of contact [23[ , the probability of transmission 
from i to j, at time t after i has been infected is given by 



i(t')dt'. 



(12) 



The overall probability that node i infects node j before 
it recovers is given by 



/ Pij(t)dt. 
10 



(13) 



This quantity is usually referred to as the transmissibility 
or infectivity of the disease. 



Effect of the shape of the distribution 

A comparison between (fTTj) and (fT2j) clearly shows 
the similarities and differences between the correspond- 
ing dynamical processes. In both cases, it is the overall 
probability that edge ij appears before another type of 
event that determines if the spreading goes through this 
edge or not. In the case of a random walk, it is a com- 
parison with the activations of neighbouring edges that 
matters. In the case of epidemic spreading, it is instead 
a comparison with the recovery process. T,y and Pjj de- 
termine the importance of an edge for each random pro- 
cess and thus the pathways of diffusion. These quantities 
provide a static representation of the dynamical process, 
not sufficient to determine properties such as the speed of 
propagation, but allowing to predict some of their their 
asymptotic properties. For random walks, Tjj defines a 
standard Markov chain that determines the asymptotic 



properties of the continuous-time random walk. For epi- 
demic spreading, P^ directly affects the basic reproduc- 
tion number Rq, namely the average number of addi- 
tional people that a person infects before recovering, in 
the limit when a vast majority of the population is sus- 
ceptible. The point Rq = 1 defines the epidemic thresh- 
old separating between growing and decreasing spread- 
ing. In tree-like networks, where all nodes have the 
same transmissibility P, one finds R = P(fc(fc — l))/(fc), 
where (k(k — l))/(k) is the expected number of suscepti- 
ble neighbors of an infected node. The epidemic thresh- 
old is thus reduced either by reducing the transmissibility 
or the ratio (k 2 )/(k). 

In epidemiology, researchers have mainly focused on 
the non-exponential nature of the recovery time distribu- 
tion, as infectious periods tend to be closely centered on 
the mean duration of infection. ri(t) is usually modeled 
by gamma distributions [24[ or approximated by delta 
peaks. Let us also note that when modeling epidemic 
spreading of ideas or trends in social networks, fat-tailed 
distributions are more appropriate [25| . In complex sys- 
tems theory and computer science, research has focused 
on the waiting time distribution ipij(t), cither modeled 
by power-law Weibull 27 1 or log- normal distribu- 



tions 



281 ] to account for the bursty dynamics observed 
in the empirical data. In this direction, it is interest- 
ing to point that much research has studied the effect of 
the tail, typically a power-law tail, of the distribution on 
spreading. Yet, it is not the shape of the tail, nor the 
moments of the distribution, that affect the pathways of 
diffusion. What matters is instead the relative position of 
one distribution with another distribution, as Eqs. (|11[) 
and (|T2"j) clearly show. For an edge to be important, it 
should appear often before some other random event. It 
is true that a small average or a fat tail [3(3] tend to fa- 
vor a distribution, but it is not always the case as the 
following toy example clearly shows. 

Let us consider epidemic spreading on a regular tree 
of identical nodes with degree 3. Each node has the re- 
covery distribution r(t) = S(t — 1), e.g. recovery times 
occur exactly at the average value 1, and each edge is 
characterized by the waiting time distribution 



m = 



l-a 
t 2 



for 
for 



* < 1, 
t > 1, 



(14) 



where a € [0, 1] tunes the shape of the distribution. For 
any value of a: i) the distribution is properly normalized; 
ii) its average (hence burstiness) is infinite; iii) it exhibits 
a power-law tail with exponent 2. Despite sharing these 
properties, the transmissibility of an edge continuously 
varies between and 1 when varying a, as 

ip(t) / 5{t' - l)dt'dt = I ip(t)dt = a. (15) 
'o Jt Jo 

This observations implies qualitatively and quantita- 
tively different spreading behaviours when tuning a, as 
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the system is above the epidemic threshold when a > 
1/2, and below otherwise. 

A corresponding example can be found for random 
walks. Consider a node from which leave two edges whose 
waiting times distributions follow (|14p with parameters 
a\ and a,i- The resulting transition probabilities can be 
spread along those edges in any possible way by a suit- 
able choice of a.\ and a-i , leading to possibly dramatically 
different behaviours of the random walker. For example 
if one of the edges is the only bridge between two parts of 
the graph, modulating its transition probability to zero 
can ultimately disconnect the graph entirely, preventing 
the ergodicity of the random walker. 

Before closing this section, let us mention a couple of 
interesting properties of (JTTJ) and ([T2|) . In general, these 
equations define the overall probability that an event A 
takes place before some other event B 

/•oo /*oo 

p A = a(t) / b(t')dt'dt, (16) 
Jo Jt 

where a(t) and b(t) are two probability distributions. The 
overall probability that B takes place before A is similarly 
defined 

/>oo />oo 

PB = J b(t) J a{t')dt'dt, (17) 

and it is straightforward to show that pa + Pb = 1- 
When both distributions are identical, a(t) = b(t), one 
finds pa = Pb = 1/2 as expected due to symme- 
try reasons. When both distributions are exponentials, 
a(t) = TA&~ TAt and b(i) = rse~ rBt , where ta and tb are 
the rates at which events take place, one finds 



Finally, when one type of event is exponentially dis- 
tributed, say b(t) = rBe~ TBt , (fTH]) simply amounts to 
the Laplace transform in the variable of the other 
distribution 

/•OO 

PA= a(t)e~ rBt dt. (19) 
Jo 

DISCUSSION 

The main purpose of this paper was to identify the 
properties of temporal patterns of edges and nodes that 
affect pathways of diffusion on time-evolving networks. 
This problem has attracted much attention in recent 
years, often leading to claims that temporal heterogeneity 
can significantly alter spreading. However, there is still 
no general understanding of the mechanisms by which 
burstiness affects the diffusive process. Is it the tail of the 
inter-event time distribution that matters, as often sug- 
gested, or its variance? Our work suggests that the most 



important factor is instead the time-ordering of events, 
which identifies the importance of an edge as the over- 
all probability (|16p that it appears before some other 
event takes place; the nature of those competing events 
depends heavily on the kind of spreading process un- 
der scrutiny. This measure of dynamical weight depends 
on the full probability distributions of those competing 
events, and seemingly more critically on their bulks than 
on their tails, because the probability mass is mainly 
concentrated in the bulk. Importantly, (|16|) is a scalar 
measure of importance of edges that aggregates their full 
sequence of activation, and thus provides a static picture 
properly taking into account the temporal dynamics of 
edges. Contrary to standard procedures, the importance 
of an edge is in general not proportional to its number 
of activations, as in (fT5|). but to the probability that it 
participates in the diffusive process. Future work will fo- 
cus on the transient properties of the diffusive processes, 
and aim at evaluating the effect of inter-event time dis- 
tributions on properties such as the mixing time, or the 
peak time. 
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